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ABSTRACT 

A communications system composed of n transmitters and r receivers and 
which is subject to failure is modeled as a semi-Markov process having four 
states. Transient and steady state results are analyzed to determine the 
probability that the system is in any given state. Two examples are given 
to illustrate the results in the transient as well as in the steady state. 
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I. INTRODUCTION 



A communications system is analyzed which has n transmitters and r re~ 
ceivers (r<n). Each transmitter works in cycles of transmission and idle 
periods of time, which are random. Each of the receivers is only capable 
of handling one message at the time, and therefore, messages transmitted 
while all r receivers are busy are then lost. 

Transmitters are subject to failure during transmission and idle periods, 
and when this occurs, it takes a random amount of time to be repaired and 
put back in service. 

The purpose of this paper is to describe a mathematical model for the 
system and analyze the transient and steady state results in order to de- 
termine the probability of a given message being lost. 

The paper is written in four parts. In Part II a model of a Semi-Markov 
process is formulated and its variables and properties defined. Part III 
contains the transient results, and Part IV the steady state results. 
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II. MODEL FORMULATION 



Given that the n transmitters composing the system have the same char- 
acteristics and work under the same conditions, the probability that any 
of them is transmitting at some arbitrary point in time is essentially the 
same. 

Suppose there are only r receivers, each of which can receive only one 
message at the time. Then if L(t) is the probability that a message trans- 
mitted at t is lost, 

L(t) = P [(r+1) or more messages are being transmitted at tj 
n 

n\ k k 

|p(t) Cl-p(t)3 , 

k = r+l 

where p(t) is the probability an individual message is being transmitted 
at t . 

Our problem is to determine p(t). Consider a system where a transmitter 
transmits for some fixed time ct , and is idle (not transmitting) for some 
fixed time 6 , Also assume the transmitter never fails and that we measure 
time zero from the start of a new transmission time. Then, 

p(t) = 1 n(a+B)^ t^ n(a+6) +a , 0,1,2, 

= 0 otherwise . 

This is illustrated in figure 1. 
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Figure 1. A simple example for p(t). 



In our model we consider the transmission and idle times as random 
variables. Also we include the possibility of transmitter failure both 
while transmitting and while idling. We assume that if it fails, it takes 
a random repair time to fix, at which point it starts over a new transmit 
or idle time, depending on its state at time of failure. Thus the system 



can be in one of four states: 




State 


Description 


0 


Transmitting 


1 


Idle and up 


2 


On repair (failure occurred 
during tranmission) 


3 


On repair (failure occurred 
during idle period) 



Let be the length of the i^^ transmission, {Tj^} i.i.d. random vari- 
ables with distribution function (d.f.) T(t). Thus T(t) = P(T^|^ ^ t), 
i = 1,2... . Also let be the length of the i^^ idle time, { I } i.i.d. 
random variables with d.f. I(t). If the system is operating (either 



transmitting or idle) we assume an exponential time to failure with rate X 
(mean time to failure is 1 / 4 .). Once failed, the time to repair is also 
assumed to be exponential at rate ^4, (mean repair time I/^ ) independent of 
whether the transmitter was idle or transmitting. 

Thus the transmitter follows a stochastic process which makes transi- 
tions according to a Markov Chain when viewed at points at which it changes 
state. It is crucial that times to failure be exponential for the Markov 
property to hold. For example, if the transmitter makes a transition from 
idle to transmit (state 1 to state 0), then if the distribution of time to 
the next transition is to be independent of all previous history of the 
process, the knowledge of when the system last failed and was repaired must 
be irrelevant. This can only be true with exponential times to failure. 

It is not important in the model that the repair times be exponential. 

The amount of time spent in each state before a transition occurs is 
random. Defining Z(t) =[ state of the process at time tj ; then the stochas- 
tic process |^Z(t), t > o| is a Semi-Markov Process, and p(t) = p[z(t) = oj . 



We now define: 



Qlj (t) = P 



process next makes a transition 
into state j and this occurs 
in a time ^ t 



?ij(t) = [ state at time t is j 

= P [ z(t) . j I Z(0) - i] 



Fy(t) = P 



a transition will occur 
in an amount of time ^ t 



process has 
just entered 
i 

process started 
in state i at 
time 0 



process has just 
entered i and 
will next enter j 



( 2 ) 



( 3 ) 



( 4 ) 
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Hij(t) 



P 



next transition occurs 
in an amount of time 6. t 



process has 
just entered 
i 



(5) 




next transition will 
be into state j 



process just 
entered i 



( 6 ) 



Since is the joint probability that the next transition is from i to 

j and in time less than t, we have 



Rj Ct) = 



Tii 



uiUen *p*C,j ^ O , ( 7 } 



and thus 



H; «•) 



3 -J 

= ^ -pij Fcj(t) = Y__ ■ 



; « o 






(?) 



It can be shown (Ross [ll) that 



3 



pijW = [1 ' Hiw] * (t-») , 



C^) 



where S is the Kroneker delta. 



If we let H^(t) = 1 - H^(t) and indicate the convolution 

in (9), we obtain 

3 

SijfflM + ^ (O , t,j>o,l, 2 , 3 . CIO) 



K.^O 
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This expression can also be written in matrix form as 



where a diagonal matrix of H£(t) and is the matrix 

convolution with ij^^ element 



J k.^o o 



Lfc. 



Ck') 



We can also define 



M'i 







Ciz) 



as the expected amount of time spent in state i during each visit; and 

(a) 

as the expected amount of time spent in i during each visit, given that 
the next state entered is j . 

It follows that 

3 
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III. TRANSIENT RESULTS 



We first examine the transient results. In order to do so, we assume 
that the transmission and idle times have general distributions, while fail- 
ure and repair times have exponential distributions. That is 



T = 


transmission time 


/V/ 


T(t) 


I = 


idle time 




I(t) 


X s 


time to failure 


/V/ 


1-e'^^ 


R = 


repair time 






first compute 7^ = [ ^ 


and 


find the 


Poi 


= P 


next transition will be 
into state 1 



= P failure time> transmission timej 

dT(x) = t(X). 



Also 



I* 



next transition will be 
into state 0 



= P failure time> transmission timej 



= P (X> I) = 



. r.->< 



dl(x) = i(/l) 



process just 
entered state 0 



process 

entered 



just 1 
state ij 



where t(^) and X) are the Laplace-Stieljes transforms of the trans- 
mission and idle times distributions evaluated at X , the failure rate. 



Now ^ 



-I'.j- 



is of the folloxjing form 
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p - 



0 

la) 

1 

o 



UA.) 

0 
0 

1 



l-lLx) 0 

o 1 “ t (A.) 



O 

0 



O 

o 



We 
Now, 



need to find F Ct) defined in (4). 

p[T<t . T< X ] 



F..W - p[T<t |T<X] = 



P(T<x] 



In order to determine the joint probability distribution of X and T 
we "condition” in the value of X. 



p[r<t,T<x|x*-»] = < 



P[T<-5^] if 
p[T<«] if , 



and then 



a men ^ f ^ ^ 

p[T<t,T<^].» f T('^) Z Ux, J T(^^) 2 ^ 

Jo ■'t 






SO 



Fo,W = 



r e- 

Jo 



t(;o 

Following the same procedure we find 
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Poa " 



FTo -> 



c- 



/ - rCt') e" - f e" <?6T (t) 

Jo 



1 - t(A:> 
t(;i) ' 



i - K-t) e"^*^ - 



We 



1- t(A) 

will now determine ^ (t) = J (t) j by using the relation de 



fined in (7) ; i. e. , 



Rj 

J rij 



This gives us 









“1 ^ ctT C^) } 

'o 

J.t . fV^“ clTCx) , 

'0 



* 1 --r(f>e"-'' - f 









(2„(-0 = 1- fWc"^*"- / ■ 



«:k, «■> ' <S,, = 5 W) - i - e'-^* , 

w = a-«) = «2»' W = <2« ' 

• •• = Q,iM = <?i.tO - o- 



By means of the relation (8) we find that 
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H„ ft) -- T (t) e' , 

R, ft) = r ft) e''^* , 

ft) ’ )?ft) , 

R, ft) = ^ • 

We now have the necessary elements to compute the relationship stated 
in (11); that is, 

^ + % *P(i) 

to determine Fm. 

Taking Laplace transforms and rewriting (11) we get 

P(^) - >4(s) t gfs)Pfs) 

which can also be OTitten 

i^fs) =[r- 

Now we have that 




0 


t 




o 






L J 




Ta^^> 


o 


o 


^[Ma.t)] 




o 


o 


O 


o 


-r(i> 


o 


o 
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where, for instance, is determined by 

[e^ d{l-e^^Tct)'f&^'ccT(r.}] 

4 /o 'o 

. [ - T(t) e'^*' 1 at 

^ r\ 



.xj 



^ ;l f T(t) ctt 



■h- xx-iui). 



where T(jt+s) is the Laplace transform of the distribution of transmission 
time, and we know that 






Xi-s 



SO then 



In our problem we are only Interested in ^qqC^); i.e., the probability 
that a transmitter isin a transmiss Lon period at time t. Then we only need 
to determine P qq(.s) . But / qq(s) is the (0,0) element of [l-q(s)J Hp(s) 
which requires only the (0,0) element of ^l-q(s)] . Because of the special 

structure of q(s) algebraic inversion to obtain this one element was possi- 
ble. After much algebra the result is 



i- 






PCs) 
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Two examples are given to illustrate the transient results. 



Example 1 

Let transmission time be exponential with mean and idle time also ex- 
ponential with mean ^ . Then 

('S) C 



^ + (/l^ + * ifi)s + + + 

^[/^( 'A ♦ + [Ct+/t)"+ c^fx-*x)('/d* 



s 



[zCX+pi)-f- 'A *'/f\ 5* + J 



This can be written as 



P ^5) 

5(6+£l)CS4f )C“54-^) 

where a, b and c must satisfy the relations 
abc = ) 

c(a+b)+ab = pi 4- 'X jf- , 

a+b+c = 5/t * i/B * X- 

Also d, f and g must satisfy 

«8 ‘ L'/p* ‘/•/)(^*p) , 

d(f+g)+£g - (_x*uS* cs^*x)ij* 'A) . 

d+f+g - ? (iv-A )<■/«(•» /j ■ 

Then the inverse of the Laplace transform in (15) will be 

T.U-f=) = ^ 60 - f) 
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where 



A- 



B = 



- Cb-ic) ii. + be 



C - / - (6vcV ^ 6c 

■ f-rf-ZK/-/; 

. _ f-(b4c)^ * be . 

U-g)(^-g) 

If xje let 

as ;?.0 U^. 



then. 



^ = j?o. o . 
I/J = iso.o 
S' 30.0 



. -.033t -.od'jt ^ ..5SC,t 

.078^-.ooie +.oi3e +. 9 p 9 & 



Figure 2 illustrates x qqC^) for different values of t. It can be ob- 
served that for the given parameters values, the system reaches the steady 
state very fast. 

Besides the method just described to take the inverse of 
numerical inversion (LINV IBM-360) was used and yielded the same results 
for ^qq(^) ^sing different values of t. 

Table I shows L(t), the probability that a message transmitted at time t 
is lost, for different values of t and for n = 30 and r = 3. 
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Figure 2. The probability that a transmitter is 
in a transmission period plotted as a 
function of t • 



L(t) 



0 sec. 1.0 

2 " 0.99 

3 " 0.99 

4 " 0.97 

5 " 0.85 

6 " 0.68 

7 " 0.49 

8 " 0.35 

9 " 0.30 

10 " 0.28 



Table I. Probability that a message transmitted 
at time t is lost. 
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Example 2 



Let of be the transmission time and p the idle period length, both 
assumed constant, and failure and repair times have exponential distribu- 
tions with parameters A and pc respectively. Then 












Using numerical inversion did not give accurate results because of the 
existence of sharp peaks in j^qqC^) ^^e constant transmission and 

idle times assumed. Exact inversion in this case was not found to be 
possible. 
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IV. STEADY STATE RESULTS 



We now examine the output of the model after a long period of time; 
that is, in the steady state. 

If we denote by J the initial state of the process, and for let 

o 

denote the state of the process immediately after the n^^ transition has 
occurred, the process ^ ^ ” 0,1,2,...| is an embedded Markov Chain with 
transition probabilities P^j = Furthermore, if the embedded Markov 

Chain is aperiodic and irreducible, defining 

P- . lim p[Z(t) - j ] i] 

it can be sho\^m (Ross [l] ) that 
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where , j = 0, 1,2,3 are the limiting probabilities for the embedded 

Markov Chain. That is, if ]T= then the are the solu- 

tions for 77” tr 7T* p , . f/'f ^ 1 , 

L j-o J 



The same examples used to illustrate the transient results will be used 
here. 

On example 1 transmission and idle times have both exponential distri- 
butions with parameters and respectively. The matrix is now given 
by 
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0 



o 



I 



1 - 



1*aX 






1 

1 

i 

o 



0 

1 



o 

0 



1 - 



1+/3X 



o 

o 



This 2^ matrix is of a chain with period 2 so is not aperiodic. How- 



ever 



the equations TT-TT-P. Iff, - 1 can still be solved in which 

f , ■ " •» *1 

JZO 



case 



the are interpreted to be the probability of being in a given state 

at an arbitrary time point. If one knew that the time point were an odd 
or even number of periods after the process started then the probability 
of being in a given state would not be given by the However, such 

a situation is not of interest to us in this paper and the ’ s are in fact 
the numbers which we want. 

Using this matrix of transition probabilities we arrive at 



'tTo = 



1+ c(X 



' j) 



K = 



where P t ^ e< 4- . 
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Recalling that we defined the expected amount of time spent in state i 



during each visit, given that the next state entered is j as 

ct? 



= j t 



we have 






1 






OX 



i/i yX 
I 

I/d*X 















The expected amount of time spent in each of the states in each 

5 



visit 



it, Ai JZ ^ 

ISO ^ 

“ l/<< + A ^ 



IS 



M- 



ys> * ^ 

A “ yU, = ^llA. ■ 



It is possible now to compute , j = 0,1, 2, 3 by using the results just 
derived and the relation stated in (16). 

On example 2 we let o( and |S be the transmission and idle times re- 
spectively, assumed constant. We also let failure and repair times have 
exponential distributions with parameters X and ^ respectively. The ma- 
trix . j will then be 
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1 - 



7 =’ = 



Using the same procedure as in example 1, we can find the necessary elements 
to solve for the Pj's. 

Table II shows the values of the Pj's> j = 0>1 j 2,3 computed for exam- 
ples 1 and 2 for o( = 2.0, |3= 20.0, 1/X ~ 180.0 and l/jjt,- 30.0 seconds. 



State j 



Probabilities Pj 



0 

1 

2 

3 



Example 1 . 

0.0779222 

0.7792229 

0.0129867 

0.1298679 



Example 2 . 
0.1109148 
0.8888418 
0.0000211 
0.0002221 



Table II . Steady state probabilities for examples 
1 and 2. 



We can now compute L(oo), the steady state probability that a message 
is lost, by means of the relation stated in Part II. 

Table III shows the values of L(oo) for different values of n and r 
for examples 1 and 2. 
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Example 


1. 






Example 


2. 


n 


r 2 


3 


4 


5 


2 


3 


4 


5 


20 


.21 


.07 


.02 


.004 


.38 


.13 


.04 


.02 


30 


.43 


.21 


.09 


.03 


. 66 


.42 


.23 


.10 


40 


.63 


.39 


.21 


.09 


.83 


.65 


.45 


.27 


50 


.77 


.57 


.37 


.20 


.92 


.81 


. 66 


.47 



Table III , Steady state probability that a message is lost 
computed for examples 1 and 2. 



The case n = 30 is shown plotted in figure 3 for different values of 
the number of receivers. For both examples we see that the loss probability 
decreases rapidly with an increase in the number of receivers, and for r = 5 
the loss probabilities decrease to .03 and .10 for examples 1 and 2 respec- 
tively. 




Figure 3 . Probability of a lost message as a 

function of the number of receivers. 
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